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This traineeship was set up to provide exposure to and experience with an 
onqo.no program of applied measurement in a university setting. The program 
directed toward discovering the unique techniques and prob'ems which improve the 
quality and efficiency of higher education through examinations. The tramee became 
familiar with the daily activities in the Measurement and Research Division Office at the 
University of Illinois He undertook related course work and engaged in disCU==ions 
pertinent t 0 his research topics He also spent a sizable portion of hi, time 
researching the use of appropriate tests for freshman selection, for P^eme 
awarding of proficiency credit for entering language students, implementation of an 
instructor evaluation program at the University and implementation of known 
technique 2 and research ffndmgs aimed at altering the educational practices at the 
EJ£2rt!' The program was considered valuable because of the experience the 
trainee gained front his close involvement with the staff and his new understanding of 
the application of objective measures to the improvement of higher education. iCb 
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A . Introduction 



This is the final report on the Postdoctoral Training 
Program conducted at the Office of Instructional Resources, 
University of Illinois, during the year of September, 1966, 
to August, 1967. 

The Office of Instructional Resources has general 
responsibility for programs and projects leading to improved 
college instruction and, specifically within its Division of 
Measurement and Research, is concerned with the problems of 
testing and evaluation over a broad spectrum of concerns re- 
lated to instruction. The Traineeship was intended to permit 
the opportunity for its recipient to work with specialists 
in measurement and research in higher education, conduct re- 
search, become proficient with advanced data processing pro- 
cedures, and to become familiar with the policies and programs 
affecting instruction in a major university. 

B. Description of the Program 

Since the program involved just a single trainee, it 
was possible to remain quite flexible and to tailor the 
program to the trainee. The particular capabilities, back- 
ground, and interests of the trainee were thus the primary 
determinants of the content of the program. 

Dr. Ronald Plaugher, the trainee, came from Educational 
Testing Service where he had been engaged in research on testing 
and measurement problems, as well as test construction and as- 
sembly for that organization. He had had no experience with 
the application of tests in a university setting, and his desire 
was to discover the techniques and problems which are unique 
to the efforts to improve the quality and efficiency of higher 
education through the use of examinations. 

The present program, therefore, was directed toward that 
end. The first few months of the period, the trainee occupied 
the same office with the Head of the Measurement and Research 
Division, becoming familiar with the daily activities and prob- 
lems of that office. This general orientation continued through- 
out the year intermittently as new aspects of the office's 
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function arose, but in the latter months the trainee began 
to pursue in greater depth those parts of the off ice* s func- 
tion which were of special interest to him. 

Simultaneously, with these basic activities, the trainee 
engaged in an orientation program for the remaining divisions 
of the Office of Instructional Resources, exposing him to the 
facilities and services being made available to the modern 
college faculty for the purposes of improving instruction. 

In addition, the trainee undertook some of the formal 
course work which was available in the Graduate Department i 

of Psychology and Education of the University. In the present 
case, this consisted of l) Multivariate Analysis in Psychology 
and Education, taught by Maurice Tatsuoka, 2) Theory of Edu- 
cational Evaluation, taught by the Division Head, 3) a pro- 
graming course for the computer-based teaching machine, PLATO, 

4) the basic Computer Systems Principles course, provided by 
IBM. 



Some of the particular aspects of the Measurement and 
Research Division^ activities which were of interest to the 
trainee and on which he chose to spend a sizable proportion 
of his time included the following: 

1. The use of appropriate tests for the selection of 
entering freshmen, including the avoidance of redundant mea- 
surement, and the prediction of specific area performance. 

2. Implementation of an instructor evaluation program 
in the University, its proper use and interpretation. 

3. Problems and practices in the use of examinations 
for placement and awarding of proficiency credit for entering 
language students. (As an outgrowth of these endeavors, two 
research papers authored by the Director and the Trainee are 
being submitted for formal journal publication.) 

4. Implementation of known techniques and research 
findings, including the education and persuasion of faculty 
members who are untrained in measurement techniques, toward 

the end of altering the educational practices of the University. 

In addition to these larger interest areas, the trainee 
engaged in numerous discussions and meetings concerning proper 
research design, measurement techniques, and data summarization 
as they are unique to the applied setting. 
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In each of the above areas, the activities of the trainee 
included extensive reviews of the relevant literature, discus- 
sions with relevant specialists and with colleagues, and in- 
volvement with the actual data analyses and manipulation that 

resulted . 

C . Evaluation c>f the Program 

a. Objectives . The objectives of the program were 
to provide exposure and experience with a functioning program^ 
of applied measurement in a university setting. The interaction 
of the trainee’s interests and capabilities with the facilities 
which were available to him served to accomplish this objective 
in an optimal manner. Given a different trainee with a different 
background, the specific activities pursued might be quite dif- 
ferent while fulfilling the same general objectives just as 
adequately . 

b. Trainee. The traineeship was late being approved 
and information was gotten out at a time when most people in 
academic positions would already have made commitment for the 
year of the traineeship. Even so, we were pleased and surprised 
with the number of responses and the quality of those responding. 
Several appointments would have been made during the first year 
had the funds been available. Subsequently, we have received 
numerous inquiries from individuals who would like to be con- 
sidered for an appointment sometime in the future. 



c. Budget . The budget was adequate. 

2 . Major Strengths or Features of the Program 

The close involvement of the trainee with the daily 
activities of the staff was a particular strength of this pro- 
gram. In this setting, therefore, the selection of the appro- 
priate trainee was of primary importance. There must be 
assurance that the background and interests of the selected 
trainee are of such a nature that they blend optimally with 
facilities, experiences, and personnel which the office has to 

offer . 

The trainee himself values his experience in the 
program very highly. The following is an excerpt from a report 
written by the trainee. "He feels he has acquired a new under- 
standing of the application of objective measures to the im- 
provement of higher education. He plans to return to Educational 
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Testing Service 1 and estimates that the experiences, course 
work, and contacts resulting from the traineeship are in- 
valuable and could have been acquired in no other manner. 

He feels he is far better qualified to conduct meaningful 
educational research as a result of the program and that its 
influences will continue to be realized in the remainder of 
his professional career.” 

3. Major Weaknesses or Difficulties 

Our major problem was related to the newness of 
the program and the fact that we had to be late in getting in- 
formation out about it. This limited the number of qualified 
applicants . 

4. Overall Evaluation 

Our observation of the trainee and comments that 
he has volunteered suggests that our initial assumption was 
substantially correct; namely, that it would be valuable to a 
young researcher interested in higher education to be affil- 
iated with an organization that has as one of its major mis- 
sions within a university research on the instructional process 
and the measurement of instructional outcomes, while at the 
same time offering him the opportunity to take advanced in- 
struction in areas of interest to him. 

5. Summary of Recommendations for Improving the USOE 

Administrat ion of the Program 

We believe now, as we did when initially applying 
for the traineeship, that it is beneficial for competent indi- 
viduals to get the specialized experience that we were able to 
offer. It seems unfortunate to us that USOE has so reconsti- 
tuted the program that a traineeship under conditions similar 
to this one are apparently no longer available. 



1 Note that the objection of the grant program would have 
been better served if the trainee had remained directly in higher 
education. He asked to remain at the University of Illinois, but 
the rules of the grant not permitting that he elected to return 
to his former employer. 
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D. Program Reports 

1. Publicity 

An announcement of the traineeship was placed in the 
American Psychologist , May, 1966, issue. 

An announcement copy attached was sent to deans and 
department heads of selected institutions, as well as to a 
number of selected individuals. 

2. Application Summary 

a. Approximate number of inquiries: about 20 

(Approximately 30 additional inquiries have been received with 
respect to the academic year 1967-68 or beyond.) 

b. Number of completed applications received 11 _ 

c. Number of first rate applications received 6 

d. How many applicants were offered admission 1 



3 . Trainee Summary 

a. Number of trainees initially accepted in 

program 

Number of trainees enrolled at the be- 
ginning of program 

Number of trainees who completed program 

b. Categorization of trainees 

(1) Number of trainees who principally 
are elementary or secondary public school teachers 

(2) Number of trainees who are princi- 
pally local public school administrators or supervisors 

(3) Number of trainees from colleges or 
universities, junior colleges, research bureaus, etc. 

Educational Testing Service 
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4. Financial Summary 

Budgeted 

a. Trainee Support 

(1) Stipends $12,000 

(2) Dependency allowance 

(3) Travel 1,200 

b. Direct Costs 

(1) Personnel 

(2) Supplies 

(3) Equipment 

(4) Travel _ ___ 

(5) Other 

c. Indirect Costs 

TOTAL $13,200 
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Expended or 
Committed 



$12,000 



1.200 



$13,200 
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POSTDOCTORAL TRAINEESHIP IN RESEARCH ON MEASUREMENT 
AND INSTRUCTION IN HIGHER EDUCATION 

University of Illinois 



The trainee will be affiliated primarily with the Office of Instructional 
Resources which has general responsibility for programs and projects 
leading to improved instruction and, specifically, within its Division of 
Measurement and Research, is concerned with the problems of testing 
and evaluation over a broad spectrum of concerns related to instruction. 
He will have the opportunity to work with professionals in measurement 
and research in higher education, to carry on projects under supervision, 
to become proficient with advanced data processing procedures, and to 
become familiar with the policies and programs affecting instruction in 
a major university. 

The trainee will also have the opportunity to consult with and take courses 
from specialists in the areas of research design, statistics, and measure- 
ment. 

The award will run from September 1966 to August 1967. The stipend 
will be $12,000 with a maximum of $1,200 available for travel and reloca- 
tion costs. 

Applicants should send a resume of academic and other related experience 
to: 



Dr. Charles J. McIntyre, Director 
Office of Instructional Resources 
205 South Goodwin 
University of Illinois 
Urbana, Illinois 61801 



